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Abstract. Cognitive computation, such as e.g. language processing, 
is conventionally regarded as Turing computation, and Turing ma- 
chines can be uniquely implemented as nonlinear dynamical systems 
using generalized shifts and subsequent Godel encoding of the sym- 
bolic repertoire. The resulting nonlinear dynamical automata (NDA) 
are piecewise affine-linear maps acting on the unit square that is 
partitioned into rectangular domains. Iterating a single point, i.e. a 
microstate, by the dynamics yields a trajectory of, in principle, in- 
finitely many points scattered through phase space. Therefore, the 
NDAs microstate dynamics does not necessarily terminate in contrast 
to its counterpart, the symbolic dynamics obtained from the rectan- 
gular partition. In order to regain the proper symbolic interpretation, 
one has to prepare ensembles of randomly distributed micros tates 
with rectangular supports. Only the resulting macrostate evolution 
corresponds then to the original Turing machine computation. How- 
ever, the introduction of random initial conditions into a determin- 
istic dynamics is not really satisfactory. As a possible solution for 
this problem we suggest a change of perspective. Instead of looking 
at point dynamics in phase space, we consider functional dynam- 
ics of probability distributions functions (p.d.f.s) over phase space. 
This is generally described by a Frobenius-Perron integral transfor- 
mation that can be regarded as a neural field equation over the unit 
square as feature space of a dynamic field theory (DFT). Solving the 
Frobenius-Perron equation, yields that uniform p.d.f.s with rectangu- 
lar support are mapped onto uniform p.d.f.s with rectangular support, 
again. Thus, the symbolically meaningful NDA macrostate dynam- 
ics becomes represented by iterated function dynamics in DFT; hence 
we call the resulting representation dynamic field automata. 

1 INTRODUCTION 

According to the central paradigm of classical cognitive science 
and to the Church-Turing thesis of computation theory (cf., e.g., 
I2lll3ll27ll33l ), cognitive processes are essentially rule-based manip- 
ulations of discrete symbols in discrete time that can be carried out 
by Turing machines. On the other hand, cognitive and computational 
neuroscience increasingly provide experimental and theoretical evi- 
dence, how cognitive processes might be implemented by neural net- 
works in the brain. 
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The crucial question, how to bridge the gap, how to realize a 
Turing machine |33 | by state and time continuous dynamical sys- 
tems has been hotly debated by "computationalists" (such as Fodor 
and Pylyshyn |8|) and "dynamicists" (such as Smolensky |30|) over 
the last decades. While computationalists argued that dynamical sys- 
tems, such as neural networks, and symbolic architectures were ei- 
ther incompatible to each other, or the former were mere implemen- 
tations of the latter, dynamicists have retorted that neural networks 
could be incompatible with symbolic architectures because the latter 
cannot be implementations of the former; see ll9]|32) for discussion. 

Moore [ 19 20] has proven that a Turing machine can be mapped 
onto a generalized shift as a generalization of symbolic dynamics 
|l7j, which in turn becomes represented by a piecewise affine-linear 
map at the unit square using Godel encoding and symbologram re- 
construction |6 , 14 1. These nonlinear dynamical automata have been 
studied and further developed by lllOlllll . Using a similar represen- 
tation of the machine tape but a localist one of the machine's control 
states, Siegelmann and Sontag have proven that a Turing machine 
can be realized as a recurrent neural network with rational synap- 
tic weights |29|. Along a different vain, deploying sequential cas- 
caded networks. Pollack |23 1 and later Moore 121] and Tabor 113 11321 
introduced and further generalized dynamical automata as nonau- 
tonomous dynamical systems (see 1121 for a unified treatment of 
these different approaches). 

Inspired by population codes studied in neuroscience, Schoner and 
co-workers devised dynamic field theory as a framework for cog- 
nitive architectures and embodied cognition where symbolic repre- 
sentations correspond to regions in abstract feature spaces (e.g. the 
visual field, color space, limb angle spaces) |7, 26]. Because dy- 
namic field theory relies upon the same dynamical equations as neu- 
ral field theory investigated in theoretical neuroscience 1(111341 . one 
often speaks also about dynamic neural fields in this context. 

In this communication we unify the abovementioned approaches. 
Starting from a nonlinear dynamical automaton as point dynamics in 
phase space in Sec.|2] which bears inteipretational peculiarities, we 
consider uniform probability distributions evolving in function space 
in Sec. [3] There we prove the central theorem of our proposal, that 
uniform distributions with rectangular support are mapped onto uni- 
form distributions with rectangular support by the underlying NDA 
dynamics. Therefore, the corresponding dynamic field, implement- 
ing a Turing machine, shall be referred to as dynamic field automa- 
ton. In the concluding Sec.|4]we discuss possible generalizations and 
advances of our approach. Additionally, we point out that symbolic 
computation in a dynamic field automaton can be interpreted in terms 
of contextual emergence ||3H5l. 



2 NONLINEAR DYNAMICAL AUTOMATA 

A nonlinear dynamical automaton (NDA: lll0tfT21 ) is a triple 
Mnda ~ {XjV,^) where (X,^) is a time-discrete dynamical 
system with phase space X = [0, 1]^ C R^, the unit square, and 
flow ^ : X ^ X.V = {D„\u = < i < m,l < 

j < n,m,n G N} is a rectangular partition of X into pairwise 
disjoint sets, n = for v ^ fj,, covering the whole phase 
space X = [J^ Dv, such that Di, = li x Jj with real intervals 
li, Jj C [0, 1] for each bi-index v = Moreover, the cells D^, 

are the domains of the branches of "I> which is a piecewise affine- 
linear map 

when X = {x,y)'^ G D^. The vectors (aj!,ay)^ G character- 
ize parallel translations, while the matrix coefficients A^, AJ^ G Rg" 
mediate either stretchings (A > 1), squeezings (A < 1), or identities 
(A = 1) along the x- and y-axes, respectively. 

The NDA's dynamics, obtained by iterating an orbit {xt G X\t G 
No} from initial condition xq through 

xt+i = $(a;t) (2) 

describes a symbolic computation by means of a generalized shift 
I19II20I when subjected to the coarse-graining V. To this end, one 
considers the set of bi-infinite, "dotted" symbolic sequences 

with symbols a^^, G A taken from a finite set, an alphabet A. In 
Eq. (O the dot denotes the observation time t — such that the 
symbol right to the dot, , displays the cuiTent state, dissecting the 
string s into two one-sided infinite strings s = (s'^, sr) with s'^ = 
the left-hand part in reversed order and sr = 
the right-hand part. Applying a Godel encoding 

oo 

X = ^(s'0 = ^VK-J6Z' (4) 

OO 

y = i/)(sh) = ^ VCffliJ^H*"^ 

to the pair s = (s^,s_r), where ip{aj) G No is an integer Godel 
number for symbol aj G A and 6^,6^ G N are the numbers of 
symbols that could appear either in sl or in sr, respectively, yields 
the so-called symbol plane or symbologram representation (a;, j/)^ 
of s in the unit square X l6l ll4l . 

A generalized shift emulating a Turing machin^is a pair Mas = 
(A^, ^P) where A^ is the space of bi-infinite, dotted sequences with 
s G A* and VI> : ^> A* is given as 

*(s) = a-^'^'(seG(s)) (5) 

with 

F -.A^ ^ Z (6) 

G:A^ ^ A% (7) 

A generalized shift becomes a Turing machine by interpreting a,;_ ^ as the 
cmTent tape symbol undemeath the head and a^j, as the cun'ent control state 
q. Then the remainder of is the tape left to the head and the remainder 
of Sr is the tape right to the head. The DoD is the word to = ai_ ^ .a^p of 
length d = 2. 



where cr : A A is the usual left-shift from symbolic dynamics 
1 17 1, F{s) — I dictates a number of shifts to the right (I < 0), to the 
left (/ > 0) or no shift at all (/ = 0), G(s) is a word w' of length 
e G N in the domain of effect (DoE) replacing the content w G A"*, 
which is a word of length d G N, in the domain of dependence (DoD) 
of s, and s © G{s) denotes this replacement function. 

From a generalized shift Mas with DoD of length d an NDA 
Mnda can be constructed as follows: In the Godel encoding (|4j the 
word contained in the DoD at the left-hand-side of the dot, partitions 
the s-axis of the symbologram into intervals li, while the word con- 
tained in the DoD at the right-hand-side of the dot partitions its j/-axis 
into intervals Jj, such that the rectangle Di, = li x Jj {v = 
becomes the image of the DoD. Moore I19II20I has proven that the 
map $ is then represented by a piecewise affine-linear (yet, globally 
nonlinear) map <I> with branches at Di, . 

In general, a Turing machine has a distinguished blank sym- 
bol, U delimiting the machine tape and also some distinguished fi- 
nal states indicating termination of a computation 1 13|. If there are 
no final states, the automaton is said to terminate with empty tape 
s = LJ°°.U°°. By mapping tpiu) = through the Godel encoding, 
the terminating state becomes a fixed point attractor (0, 0)"^ G X 
in the symbologram representation. Moreover, sequences of finite 
length are then described by pairs of rational numbers by virtue of 
Eq. Therefore, NDA Turing machine computation becomes es- 
sentially rational dynamics. 

In the framework of generalized shifts and nonlinear dynamical 
automata, however, another solution appears to be more appropri- 
ate for at least three important reasons: Firstly, Siegelmann |28| fur- 
ther generalized generalized shifts to so-called analog shifts, where 
the DoE e in Eq. Q could be infinity (e.g. by replacing the finite 
word w in the DoD by the infinite binary representation of tt). Sec- 
ondly, the NDA representation of a generalized shift should preserve 
structural relationships of the symbolic description, such as the word 
semigroup property of strings. Beim Graben et al. 0111 have shown 
that a representation of finite strings by means of equivalence classes 
of infinite strings, the so-called cylinder sets in symbolic dynam- 
ics 1 18] lead to monoid homomoiphisms from symbolic sequences 
to the symbologram representation. Then, the empty word e, the neu- 
tral element of the word semigroup, is represented by the unit interval 
[0, 1] of real numbers. And thirdly, beim Graben et al. [ilOl combined 
NDAs with dynamical recognizers 121112311311 to describe interactive 
computing where symbols from an information stream were repre- 
sented as operators on the symbologram phase space of an NDA. 
There, a similar semigroup representation theorem holds. 

For these reasons, we briefly recapitulate the cylinder set approach 
here. In symbolic dynamics, a cylinder set is a subset of the space A^ 
of bi-infinite sequences from an alphabet A that agree in a particular 
building block of length n G N from a particular instance of time 
t G Z, i.e. 



C{n,t) = [oii, . . . , ai,Jt 

= {s € A^ \st+k-i = a^^, k = l,...,n} (8) 

is called n-cylinder at time t. When now t < 0, n > |t| + 1 the 
cylinder contains the dotted word w = S-i.so and can therefore be 
decomposed into a pair of cylinders {C'{\t\,t),C{\t\ + n — 1,0)) 
where C' denotes reversed order of the defining strings again. In the 
Godel encoding Q each cylinder has a lower and an upper bound. 



given by the Godel numbers and &£, — 1, fe_R — 1, respectively. Then 

inf(V'(C'(|t|,t))) = ^(a,|,|,...,a,J 

sup(V'(C'(|t|,t))) = ^(a.|,|,...,a,J + fo-l*l 
inf(V'(C(|t|+n-l,0))) = ^(a.|,|^,,...,a,J 

sup(,/>(C(|t|+n-l,0))) 



\t\-n+l 



V'(ai|tn.i,---,ai„) + bfl 



where the suprema have been evaluated by means of geometric se- 
ries. Thereby, each part cylinder C is mapped onto a real interval 
[inf (C), sup(C)] C [0, 1] and the complete cylinder C{n,t) onto 
the Cartesian product of intervals J? = / x J C [0, 1]^, i.e. onto 
a rectangle in unit square. In particular, the empty cylinder, corre- 
sponding to the empty tape e.e is represented by the complete phase 
space X = [0,1] 2. 

Fixing the prefixes of both part cylinders and allowing for random 
symbolic continuation beyond the defining building blocks, results 
in a cloud of randomly scattered points across a rectangle R in the 
symbologram. These rectangles are consistent with the symbol pro- 
cessing dynamics of the NDA, while individual points x £ [0, 1]^ no 
longer have an immediate symbolic interpretation. Therefore, we re- 
fer to arbitrary rectangles R G [0, 1]^ as to NDA macrostates, distin- 
guishing them from NDA microstates x of the underlying dynamical 
system. In other words, the symbolically meaningful macrostates are 
emergent on the microscopic NDA dynamics. We discuss in Sec. |4] 
how a particular concept, called contextual emergence, could de- 
scribe this phenomenon HSjQ. 

3 DYNAMIC FIELD AUTOMATA 

From a conceptional point of view it does not seem very satisfactory 
to include such a kind of stochasticity into a deterministic dynam- 
ical system. However, as we shall demonstrate in this section, this 
apparent defect could be easily remedied by a change of perspective. 
Instead of iterating clouds of randomly prepared initial conditions ac- 
cording to a deterministic dynamics, one could also study the deter- 
ministic dynamics of probability measures over phase space. At this 
higher level of description, introduced by Koopman et al. U5il6il into 
theoretical physics, the point dynamics in phase space is replaced by 
functional dynamics in Banach or Hilbert spaces. This approach has 
its counterpart in neural |1, 34] and dynamic field theory |7, 26 1 in 
theoretical neuroscience. 

In dynamical system theory the abovementioned approach is 
derived from the conservation of probability as expressed by a 
Frobenius-Perron equation [22] 



p{x,t) = 5{x- $* 
J X 



{x'))p{x , t') dx' 



(9) 



where p{x, t) denotes a probability density function over the phase 
space X at time f of a dynamical system, "l?' ; X — J- X refers to ei- 
ther a continuous-time {t £ R(j') or discrete- time (t G No) flow and 
the integral over the delta function expresses the probability summa- 
tion of alternative trajectories all leading into the same state x at time 



3.1 Temporal Evolution 

In the case of an NDA, the flow is discrete and piecewise affine- 
linear on the domains Di, as given by Eq. Q. As initial probabil- 
ity distribution densities p{x, 0) we consider uniform distributions 



with rectangular support Ro G X, corresponding to an initial NDA 
macrostate, 

u{x,0) ^ -—XRoix) , (10) 
l-Kol 

where |_Ro| = vol(_Ro) is the "volume" (actually the area) of Rq and 

'O : X 4 A 



Xa{x) = 



1 : X e A 



(11) 



is the characteristic function for a set A C X. A crucial requirement 
for these distributions is that they must be consistent with the parti- 
tion V of the NDA, i.e. there must be a bi-index i/ — {i, j) such that 
the support Ro C D^. 

Inserting dlOt into the Frobenius-Perron equation (|9) yields for 
one iteration 

u{x,t+l)^ S{x-<i>{x'))u{x',t)dx' . (12) 

J X 

In order to evaluate ( 1121 . we first use the product decomposition 
of the involved functions: 



with 



u{x,0) = Ux{x,0)uy(y,0) 



(13) 

(14) 
(15) 



and 



S{x - <I>(a;')) = S{x - <i>4x'))S{y - %ix')) , (16) 

where the intervals Jo , Jo are the projections of _Ro onto x- and y- 
axes, respectively. Correspondingly, and are the projections 
of $ onto X- and y-axes, respectively. These are obtained from ([T) as 



^y{x') = ay + Xyy'. 



(17) 
(18) 



Using this factorization, the Frobenius-Perron equation (I12t sepa- 
rates into 

Ux{x,t+1) = / S{x a'^ ~ X'^x')ux{x' ,t) dx' (19) 

J [0,1] 

Uyiy-.i+i) = / S{y-ay-Xyy')uy{y',t)dy' (20) 
i[o,i] 

Next, we evaluate the delta functions according to the well-known 
lemma 

E \f'i3:i)r'6{x-xi), (21) 

Zisimple zeros 

where f'{xi) indicates the first derivative of f in xi. Eq. i21\ yields 
for the X-axis 

^ ~ (22) 



As 



i.e. one zero for each !/-branch, and hence 
\f'{xl) \ = . 
Inserting (|2T), l|22} and (|23} into ([19}, gives 



(23) 



.{x,t + l) = Y.I ^5(x' -^^-^\ux{x',t)dx' 

^ i[0,l] \ J 

El { X — a" 



\ ^x 



Next, we take into account that the distributions must be consistent 
with the NDA's partition. Therefore, for given x G there is only 
one branch of $ contributing a simple zero to the sum above. Hence, 



•j.^{x,t + l) = ^^-: 



1 



(24) 



Theorem 1 The evolution of uniform p.d.f.s with rectangular sup- 
port according to the NDA dynamics Eq. jilt is governed by 



i{x, t) = 



■X#*(flo)(^) 



(25) 



Proof (by means of induction). 

1. Inserting the initial uniform density distribution (110) for t = into 
Eq. l l24t . we obtain by virtue of ( I14> 



, 1 IX 

Ux{x, 1) = —U, 

Deploying dl lb yields 



At: 



= 



■Xio 



Xio 



x — a'^ 



Let now Jo = [po, go] C [0, 1] we get 



G /o 



Po < 



At: 



< <7o 



■<=^ + A^po < a; < flj; + Km 
$x(po) < a:: < $a:(go) 
x'^ ^x{Io) , 

Where we made use of ( I17t . 
Moreover, we have 

-^^l-fol = K{qo ~Po) = gi -pi = 
with/i = [pi,qi] = (/()). Therefore, 

uxix,l) = ■j^X/i(a;) • 

The same argumentation applies to the y-axis, such that we even- 
tually obtain 

u{x,l) ^ j^^XRiix) , (26) 

with Ri = $(i?o) the image of the initial rectangle Ro C X. Thus, 
the image of a uniform density function with rectangular support is a 
uniform density function with rectangular support again. 

2. Assume i25i is valid for some t £ N. Then it is obvious that 
i25\ also holds for t + 1 hy inserting the x-projection of J25t into 
( 124b using ( 114b . again. Then, the same calculation as under 1 . applies 
when every occurrence of is replaced by t and every occurrence of 
1 is replaced by t + 1. 

By means of this construction we have implemented an NDA by 
a dynamically evolving field. Therefore, we call this representation 
dynamic field automaton (DFA). 



3.2 Kernel Construction 

The Frobenius-Perron equation (112b can be regarded as a time- 
discretized Amari dynamic neural field equation yj which is gen- 
erally written as 



du{x, t) 
' dt 



+ u{x,t)— I w{x,x')f{u(x',t)) dx' 

J X 



(27) 



Here, r is the characteristic time constant of activation decay, 
'w{x, x') denotes the synaptic weight kernel, describing the connec- 
tivity between sites x,x' G X and / is a typically sigmoidal acti- 
vation function for converting membrane potential u{x, t) into spike 
rate f{u(x, t)). 

Discretizing time according to Euler's rule with increment At = t 
yields 

U{x,t + T)~u{x,t) , . f , '\fl I ' ^-\\ A ' 

T ^u[x,t) = / w{x,x )j(u(x ,t)) dx 



u{x, t + t) 



w{x,x')f{u{x',t)) dx' 



For r = 1 and f{u) — u the Amari equation becomes the Frobenius- 
Perron equation (112b when we set 



'j{x, x') — 5{x — ${x')) 



(28) 



This is the general solution of the kernel construction problem 
I12| [25 1. Note that ^ is not injective, i.e. for fixed x the kernel is 
a sum of delta functions coding the influence from different parts of 
the space X = [0, 1]^. Note further that higher-order discretization 
methods of explicit or implicit type such as the Runge-Kutta scheme 
could be applied to Eq. ( 127b as well. But in this case the relationship 
between the Turing dynamics as expressed by the Frobenius-Perron 
equation ^ and the neural field dynamics would become much more 
involved. We leave this as an interesting question for further research. 

4 DISCUSSION 

In this communication we combined nonlinear dynamical automata 
as implementations of Turing machines by nonlinear dynamical sys- 
tems with dynamic field theory, where computations are character- 
ized as evolution in function spaces over abstract feature spaces. 
Choosing the unit square of NDAs as feature space we demonstrated 
that Turing computation becomes represented as dynamics in the 
space of uniform probability density functions with rectangular sup- 
port. 

The suggested framework of dynamic field automata may exhibit 
several advantages. First of all, massively parallel computation could 
become possible by extending the space of admissible p.d.f.s. By al- 
lowing either for supports that overlap the partition of the underlying 
NDA or for multimodal distribution functions, one could prepare as 
many symbolic representations one wants and process them in par- 
allel by the DFA. Moreover, DFAs could be easily integrated into 
wider dynamic field architectures for object recognition or move- 
ment preparation. They could be programmed for problem-solving, 
logical interferences or syntactic language processing. In particular, 
Bayesian inference or the processing of stochastic grammars could 
be implemented by means of appropriate p.d.f.s. 

For those applications, DFAs should be embedded into time- 
continuous dynamics. This involves the construction of more com- 
plicated kernels through solving inverse problems along the lines of 
Potthast et al. I12II25I . We shall leave these questions for future re- 
search. 



The construction of DFAs has also interesting philosophical impli- 
cations. One of the long-standing problems in philosophy of science 
was the precise relationship between point mechanics, statistical me- 
chanics and thermodynamics in theoretical physics: Is thermodynam- 
ics merely reducible to point mechanics via statistical mechanics? Or 
are thermodynamic properties such as temperature emergent on me- 
chanical descriptions? 

Due to the accurate analysis of Bishop and Atmanspacher Jsj, 
point mechanics and statistical mechanics simply provide two differ- 
ent levels of description: On one hand, point mechanics deals with 
the dynamics of microstates in phase space. On the other hand, sta- 
tistical mechanics, in the formulation of Koopman et al. L15»16J (see 
Sec. [3j, deals with the evolution of probability distributions over 
phase space, namely macrostates, in abstract function spaces. Both 
are completely disparate descriptions, none reducible to the other 
However, the huge space of (largely unphysical) macrostates must 
be restricted to a subspace of physically meaningful thermal equilib- 
rium states that obey a particular stability criterium (essentially the 
maximum-entropy principle). This restriction of states bears upon a 
contingent context, and in this sense, thermodynamic properties have 
been called contextiially emergent by |5 |. 

Our construction of DFAs exhibits an interesting analogy to the 
relationship between mechanical micro- and thermal macrostates: 
Starting from microscopic nonlinear dynamics of an NDA, we used 
the Frobenius-Perron equation for probability density functions in 
order to derive an evolution law of macrostates: The time-discretized 
Amari equation ( I27t with kernel (128) . However, with respect to the 
underlying NDA, not every p.d.f. can be interpreted as a symbolic 
representation of a Turing machine configuration. Therefore, we had 
to restrict the space of all possible p.d.f.s, by taking only uniform 
p.d.f.s with rectangular support into account. For those macrostates 
we were able to prove that the resulting DFA implements the orig- 
inal Turing machine. In this sense, the restriction to uniform p.d.f.s 
with rectangular support introduces a contingent context from which 
symbolic computation emerges. (Note that uniform p.d.f.s also have 
maximal entropy). 

ACKNOWLEDGEMENTS 

This research was supported by a Heisenberg grant (GR 3711/1-1) 
of the German Research Foundation (DFG) awarded to PbG. Pre- 
liminary results have been presented at a special session "Cognitive 
Architectures in Dynamical Field Theory", that was partially funded 
by an EuCoglll grant, at the 2nd International Conference on Neural 
Field Theory, hosted by the University of Reading (UK). We thank 
Yulia Sandamirskaya, Slawomir Nasuto and Gregor Schoner for in- 
spiring discussions. 

References 

[1] S.-I. Amari, 'Dynamics of pattern formation in lateral- inhibition type 
neural tields', Biological Cybernetics, 27, 77 - 87, (1977). 

[2] J. R. Anderson. Cognitive Psychology and its Implications, W. H. Free- 
man and Company, New York (NY), 1995. 

[3] H. Atmanspacher and P. beim Graben, 'Contextual emergence of men- 
tal states from neurodynamics'. Chaos and Complexity Letters, 2(2/3), 
151 - 168, (2007). 

[4] H. Atmanspacher and P. beim Graben, 'Contextual emergence', Schol- 
arpedia, 4(3), 7997, (2009). 

[5] R. C. Bishop and H. Atmanspacher, 'Contextual emergence in the de- 
scription of properties', Foundations of Physics, 36(12), 1753 - 1777, 
(2006). 



[6] P. Cvitanovic, G. H. Gunaratne, and I. Procaccia, 'Topological and met- 
ric properties of Henon-type strange attractors'. Physical Reviews A, 
38(3), 1503- 1520, (1988). 
[7] W. Erlhagen and G. Schoner, 'Dynamic field theory of movement 

preparation'. Psychological Review, 109(3), 545 - 572, (2002). 
[8] J. Fodor and Z. W. Pylyshyn, 'Connectionism and cognitive architec- 
ture: A critical analysis', Cognition, 28, 3 -71, (1988). 
[9] P. beim Graben, 'Incompatible implementations of physical symbol 
systems'. Mind and Matter, 2(2), 29 - 5 1, (2004). 

[10] P. beim Graben, S. Gerth, and S. Vasishth, 'Towards dynamical system 
models of language-related brain potentials', Cognitive Neurodynam- 
ics, 2(3), 229 - 255, (2008). 

[11] P. beim Graben, B. Jurish, D. Saddy, and S. Frisch, 'Language process- 
ing by dynamical systems'. International Journal of Bifurcation and 
Chaos, 14(2), 599 - 621, (2004). 

[12] P. beim Graben and R. Potthast, 'Inverse problems in dynamic cognitive 
modeling', Chaos, 19(1), 015103, (2009). 

[13] J. E. Hopcroft and J. D. Ullman, Introduction to Automata Theory, Lan- 
guages, and Computation, Addison-Wesley, Menlo Park, California, 
1979. 

[14] M. B. Kennel and M. Buhl, 'Estimating good discrete partitions from 
observed data: Symbolic false nearest neighbors', Physical Review Let- 
ters, 91(8), 084102, (2003). 

[15] B. O. Koopman, 'Hamiltonian systems and transformations in Hilbert 
space'. Proceedings of the National Academy of Sciences of the U.S.A., 
17,315-318,(1931). 

[16] B. O. Koopman and J. von Neumann, 'Dynamical systems of continu- 
ous spectra' , Proceedings of the National Academy of Sciences of the 
f/.S.A..18, 255-262,(1932). 

[17] D. Lind and B. Marcus, An Introduction to Symbolic Dynamics and 
Coding, Cambridge University Press, Cambridge (UK), 1995. 

[18] B. McMillan, 'The basic theorems of information theory', 24, 196 - 
219, (1953). 

[19] C. Moore, 'Unpredictability and undecidabiUty in dynamical systems'. 

Physical Review Letters, 64(20), 2354 - 2357, (1990). 
[20] C. Moore, 'Generalized shifts: unpredictability and undecidabiUty in 

dynamical systems', Nonlinearity, 4, 199 - 230, (1991). 
[21] C. Moore, 'Dynamical recognizers: real-time language recognition by 

analog computers'. Theoretical Computer Science, 201, 99 - 136, 

(1998). 

[22] E. Ott, Chaos in Dynamical Systems, Cambridge University Press, New 
York, 1993. 

[23] J. B. Pollack, 'The induction of dynamical recognizers'. Machine 
Learning, 7, 227 - 252, (1991). Also published in |24|, pp. 283 - 312. 

[24] Mind as Motion: Explorations in the Dynamics of Cognition, eds., R. F. 
Port and T. van Gelder MIT Press, Cambridge (MA), 1995. 

[25] R. Potthast and P. beim Graben, 'Inverse problems in neural field the- 
ory', SIAM Jounal on Applied Dynamical Systems, 8(4), 1405 - 1433, 
(2009). 

[26] G. Schoner and E. Dineva, 'Dynamic instabilities as mechanisms for 
emergence', Developmental Science, 10(1), 69 - 74, (2007). 

[27] H. T. Siegelmann, 'Computation beyond the Turing limit'. Science, 
268(5210), 545 - 548, (1995). 

[28] H. T. Siegelmann, 'The simple dynamics of super Turing theories' , The- 
oretical Computer Science, 168, 461 - 472, (1996). 

[29] H. T. Siegelmann and E. D. Sontag, 'On the computational power of 
neural nets'. Journal of Computer and System Sciences, 50(1), 132 - 
150, (1995). 

[30] P. Smolensky, 'On the proper treatment of connectionism' , Behavioral 
and Brain Sciences, 11(1), 1 -74, (1988). 

[31] W. Tabor, 'Fractal encoding of context-free grammai's in connectionist 
networks'. Expert Systems: The International Journal of Knowledge 
Engineering and Neural Networks, 17(1), 41 - 56, (2000). 

[32] W. Tabor, 'A dynamical systems perspective on the relationship be- 
tween symbolic and non-symbolic computation'. Cognitive Neurody- 
namics, 3(4), 415 - 427, (2009). 

[33] A. M. Turing, 'On computable numbers, with an application to the 
Entscheidungsproblem' , Proceedings of the London Mathematical So- 
ciety, 2(42), 230 - 265, (1937). 

[34] H. R. Wilson and J. D. Cowan, 'A mathematical theory of the functional 
dynamics of cortical and thalamic nervous tissue', Kybernetik, 13, 55 - 
80, (1973). 



